Mixture-based estimation of entropy

نویسندگان

چکیده

The entropy is a measure of uncertainty that plays central role in information theory. When the distribution data unknown, an estimate needs to be obtained from sample itself. A semi-parametric proposed based on mixture model approximation interest. Gaussian used illustrate accuracy and versatility proposal, although can rely any type mixture. Performance approach assessed through series simulation studies. Two real-life examples are also provided its use.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

On the Estimation of Shannon Entropy

Shannon entropy is increasingly used in many applications. In this article, an estimator of the entropy of a continuous random variable is proposed. Consistency and scale invariance of variance and mean squared error of the proposed estimator is proved and then comparisons are made with Vasicek's (1976), van Es (1992), Ebrahimi et al. (1994) and Correa (1995) entropy estimators. A simulation st...

متن کامل

Simple Equations for Predicting Entropy of Ammonia-Water Mixture

This work presents a set of three simple and explicit equations as a function of temperature, pressure, and mass fraction for calculation of the entropy of the ammonia-water mixture in saturated and super heated conditions. They are intended for use in the optimization and second law efficiency of absorption processes. The equations are constructed by the least square method for curve fitting u...

متن کامل

Multivariate Edgeworth-based Entropy Estimation

We develop the general, multivariate case of the Edgeworth approximation of differential entropy, and introduce an approximate formula for Gaussian mixture densities. We use these entropy approximations in a new algorithm for selecting the optimal number of clusters in a data set, and in a new mutual information test with which one can statistically decide whether a distribution can be factoriz...

متن کامل

Statistical Wavelet-based Image Denoising using Scale Mixture of Normal Distributions with Adaptive Parameter Estimation

Removing noise from images is a challenging problem in digital image processing. This paper presents an image denoising method based on a maximum a posteriori (MAP) density function estimator, which is implemented in the wavelet domain because of its energy compaction property. The performance of the MAP estimator depends on the proposed model for noise-free wavelet coefficients. Thus in the wa...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Computational Statistics & Data Analysis

سال: 2023

ISSN: ['0167-9473', '1872-7352']

DOI: https://doi.org/10.1016/j.csda.2022.107582